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A E S TRACT 



A quality control model is proposed to facilitate 
development oi effective instructional programs. The theories ot R. 

V . . Gagne in d of M, D. Merrill provide the t oun iations tor <? theory ot 
sequencing behavior into a hierarchical order m order to improve the 
learning potential of an instructional program. The initial stop in 
the procedural model is io identity the enabling objectives which 
allow performance ot the terminal objective. After these objectives 
are identified and h > c t arch real 1 y chatted, the sequence is validated 
by a task analysis. An evaluation by individuals tor whom the progian 
is designed should eliminate ambiguous directions. The next step i n 
the model is an empirical validation ot the entire program to 
determine if the student reaches the terminal objective successfully 
and it the sequencing is effective and efficient* Finally the program 
is revised according to the results obtained in the preceding step 
and recycled until a a acceptable criterion is ronched. (.1 Y ) 
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A QUALITY CONTROL DESIGN FOR VALIDATING 
HIERARCHICAL SEQUENCING OF PROGRAMED INSTRUCTION 

Robert D. Ttnnyson Richard C. Bout well 

Brigham Young University 

With the inception of programed instruction as a serious pursuit 
by psychologists and educators, the problem of sequencing subject 
matter has been chronic. Early efforts to demonstrate the superiority 
of various schemes for determining optional sequences have been dis- 
appearing. Research findings do not generally differentiate between 
the effectiveness of an ordered sequence over a random sequence. 
Sequencing seems to be complicated by two factors: the failure to 
recognize that conditions of learning appropriate to one task are not 
appropriate to another: arid inadequate methods of empirically valid- 
ating programs. 

In Con ditio ns of Learning, Gagne' 11965, 1970) stated the eight cond- 
itions of learning as: signal learning, stimulus -response learning, 
chaining, verbal association, discrimination learning, concept learn- 
ing, rule learning, and problem solving. Gagud\s hierarchy is the 
first model to bridge basic learning theory and the more applied con- 
cerns of instructional psychologists. By discussing the conditions 
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net i ssary for learning, Gagne enabled translation of essential con- 
ditions into manipulated instructional strategy' for maximally effic- 
ient and effective learning. Gagnons Initial book (1965; second edition, 
1970), and his papers (19G7, 1968) have influenced educational tech- 
nologists to change focus from attempts to adapt abstract learning 
theory to the development of instructional theories based on a hier- 
archical sequence, Gagne' asked the question, ”Is there a sequence 
of forms of learning, from simple to complex, that should be follow- 
ed in instruction?’ 1 (1965, p. 179). lie answered affirmatively, anu 
continued his discussion by insisting that there needs to be a method 
of deciding M what is to be learned before what. " His hierarchy dev- 
eloped on the premise that each level of learning requires a unique 
condition and that a differing form of external situation is needed for 
each behavior. 

However, Gagne has failed to separate learning hierarchy from 
logical hierarchies. The identification of hierarchical conditions is 
not arbitrary, T. e, , problem solving behavior depends on analysis 
behavior; which depends on classification behavior; etc. f down tne 
hierarchy of prerequisites. This contrasts with a logical hierarchy 
where the subject matter dictates the sequence and is assumed to exist 
in a hierarchy of conditions. An example of a Gagne' logical hierarchical 
Hov. chart which caVv’u es factor numbers into prime numbers written 
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in exponential form is Figure 1. This chart represents the us^al pro- 
cedure of outlining the subject matter on a supposed logical sequence 
determined by a subject mutter expert who assumes that to reach iho 
terminal objective a person would have to be taught according to the 
flow of the arrows, The teiminal oehavior (Fig. 1) represents problem 
solving proceeded by rules and < oncepts. 

Insert Figure I about heie 

A learning Merarcl , is sequenced according to conditions of behavior 
not subject matter. Complex subject matter is not appropriate as a 
sequencing method because it fails to follow consistent older, Peha- 
vioral levels, on the contrary, can accept various orders of subject 
matter because they are controlled by differing instructional processes 
which are dependent upon the behavior required. Merrill’s paradigm of 
instruction (Fig* 2) docs provide a learning hierarchy using levels of 
behavior. 

Insert v igure 2 about here 

K motional behavior is assumed to apply at all levels of instruction, 
and is plac ?d at the top of the model. The hierarchical structure is 
based upon the presumption of essential prerequisite conditions moving 
from the lowest level of instruction, psychomotor, to the highest corn- 
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P-ex a^Mtwc:. Wuhin each level the sequence mc/es from left to right 

in a simple -to -complex structure. Each level corresponds vertically 

in component definitions; c. g. , chaining behavior, serial behavior , and 

analysis behavior are a series of single responses learned in the previou 
1 

condition. The behaviors required on the complex cognitive level are: 
classification behavior requires that a student identify correctly pre- 
viously unencountered instances of a concept class; analysis behavior 
requires tint a student demonstrate the functional relationship of the 
eomponen* concepts of a principle in an unencountered situation; 
problem sowing nehavior requires a student to analyze several prin- 
ciples and synthesize a strategy for solution. 

Analysis behavior, for example, differs from G?.gue /f s rule learning 
in that Merrill is concerned with the students use of the principle, 
whereas, Gagne 7 is concerned with identifying components of the princ- 
iple. The difference between the logical hierarchy (Fig. 1) which is 
snl ject matter controlled, and a learning hierarchy which is controlled 
by behavior, is Figu r 3. In both cases the hierarchy must be validated 
prior to correct sequencing. 

Insert Figure 3 about here 

Validating hierarchical sequencing involves procedures to main- 
tain quality control. Such a design mcoporates these five basic com- 
ponents: learning hierarchy , task analysis, individual evaluation of 
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directions, empirical validation of program, and revision (Fig. 4). 

This mo^cl is unique because of the inclusion of two procedures to 
validate the sequence fox' conditions of learning and for efficency and 
effectiveness of instruction. 

Insert Figure 4 about here 

Learning Hierarchy 

Sequencing behavior into a hierarchical order requires a detailed 
analysis of the objectives provided by the procedural steps of Merrill's 
paradigm (Fig. 2). Gagne', Markle, anr’ Merrill have emphasized that 
the beginning of any design for programed instruction is the terminal 
behavior, r he traditional form of a Mager-type (1962) behavior object- 
ive (i.e. ; conditions, criteria, and behavior) does not refer to the cond- 
ition of learning the student is to exhibit at the end of : struction. 

The next procedure is to identify the enabling objectives (Pig. 4) of 
the terminal objective. What must a student do to perform the terminal 
objective? Following Merrill's paradigm, the first enabling objectives 
for problem solving would be the "analysis behavior” level (Fig. 2). 

This procedure continues until a sequence of enabling objectives are 
identified as prerequisites for the higher order behaviors. How far 
down the paradigm the designer goes is a qualitative decision at this 
point. The progranier must estimate the S f s competency level. In 
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elementary grades and industrial arts the objectives might include psy- 
chornotor behavior as part of the enabling objectives with thd terminal 
behavior being complex cognitive. However, most instruction assumes 
relevant psychomotor behavior as prerequisite* Behavior which* the 
learner is assumed to have prior to the new instruction must be specif- 
ied. Figure 5 details the idea of assumed behaviors. These behaviors 
need in-depth anal} ois so that necessary conditions are not omitted 
from the instruction. 

insert figure 5 about here 

Instructional objectives can best be identified by the preparation cf a 
flow diagram indicating the sequence of behaviors (Fig. 6). In thic example 
for a seventh grade Knglish course in sentence construction, che terminal 
objective is problem solving behavior. The student will be able to write 
a complete, accurate sentence when finished with the instruction. Only 
one principle from the analysis behavior level is illustrated with concepts. 
Memorization and psychomotor levels of behavior are assumed. 

Insert Figure 6 about here 

T ask A naly sis 

After the objectives are identified and hierarchically charted, the 
next procedure is to validate the sequence by a task analysis. A task 
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analysis is a process by which the learning hierarchy is evaluated with- 
out instruction. An instrument is constructed so that each behavior on 
the hierarchical chart is tested not with one, but several, items. Ac - 
curate evaluation is essential for proper sequent’ ir. r . Tne instrument 
should be administered to a random sample of subjects comprising 
those who can perform the behaviors indicated; those who can perform 
some, bat not all, of the behaviors; and those who cannot perform any 
of the behaviors. Three different groups are essential because the lirst 
group measures the attainability of the terminal behavior; the second 
group measures the- difficulty of the enabling objectives; and the third 
group represents samples from the population for whom the program 
is being developed. The eva ab of the behavioral objectives can be 
accomplished by using a task analysis grid. 

The levels of behavior are d.vided into units, and are measured by 
appropriate items on the instrument, i. e. , within each unit are items 
which test the identified behavior. The units are tested by criterion 

reference norms. If the subject obtains the criteria he is assumed to 
know the behavior. On the horizonatal axis of the task analysis grid 
(Fig. 7) are the behavioral objectives identified as the units represent- 
ing the example from Figure 6. The terminal objectives, units 5 and 6, 
are to the right, and the enabling objectives, units 4,3,2 and l are in 
descending order to the left. The subjects criterion scores (X’s), in- 
dicating passing, are arranged on the vertical axis according to the 
number of units passed. 



Insert Figure 7 about here 

'Phis graph evaluated the sequence of the behavioral units. Units that 
are the most successfully passed should be the units on the lowest of be- 
havior, In the example shown (Fig. 7), the classification behavior units 
are in proper order. However, problems are apparent in the analysis and 

problem solving units. Two possible errors could account for this situation. 
First, the test does not adequately me asure the behavior. Or, secondly, the 
behaviors thought to be analysis and problem solving are not. Both errors 
could occur simultaneously, thus complicating analysis. In either case a 
reexamination of the behaviors and the test items is needed. A second task 
analysis should result in a graph resembling Figure 8. The task analysis pro- 
cedure assures that the hierarchy for the instruction is empirically validated. 

Insert Figure 8 about here 



Insert Figure 9 about here 

A logical hierarchy task analysis (Gagne', 1965, 1970) differs significantly. 
Jn the example shown (Fig. 7), units four and six would be considered out of 
sequence because too many subject reached criteria. Units three and five 
would be considered too low on the sequence because too few subjects reach- 
ed criteria. On the basis of this analysis, the flow diagram would be rear- 
ranged (Fig. 9) to reflect the empirically derived sequence observed in the 
subjects measured by the test. Writing of the program would follow the seq- 
uence as illustrated in Figure 9; i.e. , units 1, 2, 6, 4, 5, 3. This task anal- 
ysis procedure is inappropriate because subject matter is analyzed instead of 
levels of behavior. 
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Lvny/i'j*: .Evalu ation of Direction s 

Individual try-outs with those for whom the program is designed 
precedes an evaluation of the entire program in order that ambiguous 
directions are eliminated. Rewording, reorganizing, deletion, or 
addition, at this point can avoid complications when validating the 
entir program. 

Empirical Valid ation o f Program 

Empirically validating the instructional program is the fifth step 
of quality control. This evaluation is concerned not only with the student 
reaching the terminal objective successfully but, also, with determin- 
ing if .he sequencing is effective and efficient. Group evaluation confirms 
the sequential structure by administration to a random sample of subjects. 
A common method of program validation (Fig. 10) involves contrasting 
the program with some other form of instruction. This model is in - 
adequate, due to the undefined M other instruction. M A prion assump- 
tion by programers is that a program can teach. A model of sequencing 
should be constructed to determine final internal validity of the p. ogram. 

A Full vs. Incomplete validation model (Fig. IP meets this criteria. Any 
number of deletions and alternations can be constructed to analyze the 
sequence. The usual procedure is to test the sequence from one level 
of behavior to the next. As an example, the analysis behavior could be 
left out of the Full program to test the effect of instruction going from 
classification behavior to problem solving. This procedure differs 
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from the task analysis (only known behavior is measured), in that instruc- 
tional strategies are included. 

Insert Figure 10 about here 

Insert Figure 11 about heie 

Revision of Program 

Revision of the program is the concluding procedure of quality control. 
The program is revised according to the results in the above step and 
recycled until an acceptable criterion is reached. This recycling includes 
adjusting the hierarchical sequencing and/or deletion of unnecessary in- 
struction. In addition to possible instructional changes, revision allows 
a reexamination of the procedural validity of the program. 

Conc lusion 

Hierarchical sequencing based on instructional theories aids tech- 
nologists in program development, Gagne and Merrill have helped in 
determining instructional objectives based on conditions of learning. 

On the other end of the continuum, abundant references have helped to 
evaluate test instruments. However, program development has not 
been subjected to minimum standards. As a result, problems from 
sequencing of conditions have produced learning errors. The quality 
control model discussed in this article is to facilitate development of 
effective instructional programs. 
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FOOTNOTE 



For a complete analysis and comparison ot Bloom, Gagne' and Merrill 
see Tennyson and Merrill (1970). 
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Calculate factor 
numbers into prime 
numbers written in 
exponential form 
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Exponents 



A 



Factorization 



Multiply numbers 
to obtain a 
product 



A 




Divide one 
number to 
obtain another 
product 



j 



Prime 


[" Composite 


Numbers 


j Numbers 

i 



Figure 1: A logical hierarchy using GagneCs procedure. 
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Memorization 
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Figure 2. Merrill's paradigm of instruction. The ten categories of 
learned behavior are hierarchically sequenced starting with topographic 
behavior, moving from left to right - top to bottom, to problem solving 
behavior. There is a relationship if behaviors vertically, i. e. , the 
first column represents single responses, the second column represents 
a series of responses, and the third column represents a set of behaviors. 
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Figure 3. A learning hierarchy based upon Merrill's levels of behavior. 
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Figure 4. Flow chart of quality control in instructional design. The 
bold boxes represent the critical points of sequential validation. 
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Figure 5, This flow chart illustrates the prerequisite assumptions (bold boxes) 
made for each condition of a proposed program on the Shakespearean sonnet. 

Key: The above flow chart boxes are numbered and correspond to the numbered 
statements below. 

1. The student, when presented a group of fourteen lines of poetry, each of 

which rhymes with one of the other lines, will construct a Shakespearean 

sonnet. 

2. Assumed: The student knows: 

A. that the Shakespearean sonnet is named for William Shakespeare because 
he wrote many sonnets using this sonnet form; and, that the Shakespearean 
sonnet is also called the English sonnet. 

B. that there are two kinds of sonnets: the Shakespearean, or English sonnet 
and the Petrarchan sonnet, or Italian sonnet. 

C. that a Sonnet is a poem of fourteen lines. 

D. that a Poem is an arrangement of words in verse. 

E. that a Verse is a single line of poetry; a sequence of words (constituting 
a single line of poetry) arranged metrically. 
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3. Assumed: The student knows: 

A. that a Metrical Measurement, of the sequence of words which constitute 
a single line of poetry, is specifically named Meter. 

B. that Meter is a measured, patterned arrangement of syllables. 

a. that a Syllable is a word or part of a sounding of the voice. 

b. that a Foot is the basic unit of measurement; that the repetition of 
Feet produces a pattern that can be Metrically Measured; that the 
most common Feet in Fnglish poetry are: 

L iamb^-O 

2. trochee (/cy; 

3. anapest ( uy cv /) 

4. dactyl (/uoj 

5 . spond ee(//J ; that the number of Feet is counted and the following 
names are used: 

1. monometer (one foot) 
dimeter (tw r o feet) 

3. trimeter (three feet) 

4. tetrameter (four feet) 

5. pentameter (five feet) 

6. hexameter (six feet) 

C. that Metrical Measurement is the measurement (number, extent) of the 
stressed, or accented (/) syllables and the unstressed, or unaccented 
(<s) syllables. 

a. that the stressed syllables are indicated by the mark / . 

b. that the unstressed syllables are indicated by the mark ^ . 

4. Assumed: The student know's: 

A. that a Rhyme Scheme is a pattern of rhymes used in a poem , usually 
indicated by letters, such as: abab, or ccdd, etc. 

B. that the Rhyme is a recurrence of corresponding sounds, especially at 
the end of lines. 

5. The student, when presented a Shakespearean sonnet will be able to identify 
the thought development of the sonnet and will be able to compare this thought 
development to the stanza form. 

6. Assumed: The student knows: 

A. that the Shakespearean sonnet stanza form comprises: 

a. three quatrains 

b. one couplet 

B. that a Quatrain is a f outline stanza. 

C. that a Couplet is a twoline stanza. 

7. Assumed: The student knows: 

that the Thought Development is not how r you can interpret the ideas or thoughts 
presented in a poem, but how (some pattern, some sequence or order) the ideas 
or thoughts are presented'. 
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How should a complete, accurate 
(Problem Solving Behavior) [ sentence be structured? 
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Figure 6. A sample flow diagram of a learning hierarchy prior to a task analysis. 

Only one sequenc a is shown to illustrate ? hierarchv using Merrill's paradigm. 
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Behavioral Objective Units 



Classification 



1 

2 

3 

4 

5 

6 

7 

8 



1 

X 

X 

X 

X 

X 

X 

X 

X 



X 

X 

X 

X 

X 



Analysis 
3 4 

X X 

X 

X X 

X 



X 



Problem Solving 
5 6 

X X 

x >: 

x 



X 

X 

X 



Fig-are 7, A task analysis grid validating che hierarchical 
sequence on sentence construction from Figure 5. The "X’s" 
represent subjects criterion scores on the vertical axis, 
indicating passing. The horizontal axis represents the 
terminal objective (problem solving) with enabling objectives 
(analysis and classification) in sequence to the left. 
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Behavioral Objective Units 



Classification 
1 2 

X X 

X X 

X X 

X X 

X X 

X X 

X 

X 



Analysis Problem Solving 

3 4 5 6 

X X X X 

XXX 

X X 

X 



Figure 8. A task analysis grid should Look like this one following 
revision of the behaviors and test. 
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Logical Hierarchy Units 
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X 

X 

X 



Figure 9. In the usual task analysis only a reordering of the units 
would occur. 
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Program 


Posttest 


Pretest 


Other Instruction 


Posttest 



Figure 10, Comparative validation model. 
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Pretest 


Program A 


Posttest 


Fretest 

1 


Program A-B 

i 


Posttest 



Figure 11. Full vs. Incomplete validation model. 

To evaluate the final sequence of conditions the main 
program (A) is contrasted with a program that has 
had part (B) of t'.ie program removed. 
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